Quantifying Changes in Timelapse Images

1 Problem: Timelapse images are packed with information

Between fixed cameras, satellite images, fly-overs and a variety of other sources, there are ever more archives of images with high (

Next we focus on the differences between the images

SELECT LA.image-LAB.image FROM LakeUrmia LA 
  JOIN LakeUrmia LAB ON DAYDIFF(LA.Date,LAB.Date)==1

1.1 Selfie Tracking

New satellite systems like Sentinel-1/2, Planet Labs’ Dove Program, and countless other projects aim to provide nearly real-time imaging of the entire planet.

First we select our current set of images (LakeUrmia) from the archive

SELECT image FROM TimelapseArchive WHERE Location IS "Lake Urmia" 
  AND Date.Year BETWEEN 1984 AND 2012

Next we focus on the differences between the images

SELECT LA.image-LAB.image FROM LakeUrmia LA 
  JOIN LakeUrmia LAB ON DAYDIFF(LA.Date,LAB.Date)==1

1.2 Model-Driven Approach

Rather than focusing only on the differences, we can utilize a model-based approach to analyze the data

\[\rightarrow \textrm{Segment different regions of the image based on land-cover}\]

SELECT Segment_Water(Image) as WaterArea FROM TimelapseArchive

\[ \downarrow \textrm{ Extract the heart since it is the most dose-sensitive} \]

SELECT HeartRegion FROM ChestSeq

\[ \downarrow \textrm{ Track the Position of the Heart} \]

SELECT CenterOfMass(roi) FROM LakeRegion GROUP BY time

2 Learn More

4Quant is active in a number of different areas from medicine to remote sensing. Our image processing framework (Spark Image Layer) and our query engine (Image Query and Analysis Engine) are widely adaptable to a number of different specific applications.

2.1 Use Cases

Check out our other use-cases to see how 4Quant can help you

2.1.1 Medicine

• Planning surgery and radiotherapy with real time segmentations
• Segmenting organs from archived chest CT images
• Finding lesions in Capsule Based Endoscopy

2.1.2 Geographic Information Systems

• Calculating Flood Risk for Insurance Companies
• Counting Cars in Satellite Images
• Finding buildings and forests in Satellite Images

2.1.3 Surveillance

• Count people from drone footage
• Finding criminals with traffic cameras

2.1.4 Real-time QA

• Check train tracks in real time

2.1.5 Fun

• Untangling the flood of Online Dating
• Quantitative Image Search Machine

2.2 Technical Presentations

To find out more about the technical aspects of our solution, check out our presentation at:

• Spark Summit or watch the video.
• Synchrotron Radiation Instrumentation 2015
• ICTMS 2015
• LifeScienceForumBasel 2015

3 Acknowledgements

Data was obtained from the video. Analysis powered by Spark Image Layer from 4Quant, Visualizations and Document Generation provided by:

To cite ggplot2 in publications, please use:

H. Wickham. ggplot2: elegant graphics for data analysis. Springer New York, 2009.

A BibTeX entry for LaTeX users is

@Book{, author = {Hadley Wickham}, title = {ggplot2: elegant graphics for data analysis}, publisher = {Springer New York}, year = {2009}, isbn = {978-0-387-98140-6}, url = {http://had.co.nz/ggplot2/book}, }

To cite package ‘leaflet’ in publications use:

Joe Cheng and Yihui Xie (2014). leaflet: Create Interactive Web Maps with the JavaScript LeafLet Library. R package version 0.0.11. https://github.com/rstudio/leaflet

A BibTeX entry for LaTeX users is

@Manual{, title = {leaflet: Create Interactive Web Maps with the JavaScript LeafLet Library}, author = {Joe Cheng and Yihui Xie}, year = {2014}, note = {R package version 0.0.11}, url = {https://github.com/rstudio/leaflet}, }

To cite plyr in publications use:

Hadley Wickham (2011). The Split-Apply-Combine Strategy for Data Analysis. Journal of Statistical Software, 40(1), 1-29. URL http://www.jstatsoft.org/v40/i01/.

A BibTeX entry for LaTeX users is

@Article{, title = {The Split-Apply-Combine Strategy for Data Analysis}, author = {Hadley Wickham}, journal = {Journal of Statistical Software}, year = {2011}, volume = {40}, number = {1}, pages = {1–29}, url = {http://www.jstatsoft.org/v40/i01/}, }

To cite the ‘knitr’ package in publications use:

Yihui Xie (2015). knitr: A General-Purpose Package for Dynamic Report Generation in R. R package version 1.10.

Yihui Xie (2013) Dynamic Documents with R and knitr. Chapman and Hall/CRC. ISBN 978-1482203530

Yihui Xie (2014) knitr: A Comprehensive Tool for Reproducible Research in R. In Victoria Stodden, Friedrich Leisch and Roger D. Peng, editors, Implementing Reproducible Computational Research. Chapman and Hall/CRC. ISBN 978-1466561595

To cite package ‘rmarkdown’ in publications use:

JJ Allaire, Joe Cheng, Yihui Xie, Jonathan McPherson, Winston Chang, Jeff Allen, Hadley Wickham and Rob Hyndman (2015). rmarkdown: Dynamic Documents for R. R package version 0.7. http://CRAN.R-project.org/package=rmarkdown

A BibTeX entry for LaTeX users is

@Manual{, title = {rmarkdown: Dynamic Documents for R}, author = {JJ Allaire and Joe Cheng and Yihui Xie and Jonathan McPherson and Winston Chang and Jeff Allen and Hadley Wickham and Rob Hyndman}, year = {2015}, note = {R package version 0.7}, url = {http://CRAN.R-project.org/package=rmarkdown}, }

To cite package ‘DiagrammeR’ in publications use:

Knut Sveidqvist, Mike Bostock, Chris Pettitt, Mike Daines, Andrei Kashcha and Richard Iannone (2015). DiagrammeR: Create Graph Diagrams and Flowcharts Using R. R package version 0.7.

A BibTeX entry for LaTeX users is

@Manual{, title = {DiagrammeR: Create Graph Diagrams and Flowcharts Using R}, author = {Knut Sveidqvist and Mike Bostock and Chris Pettitt and Mike Daines and Andrei Kashcha and Richard Iannone}, year = {2015}, note = {R package version 0.7}, }